(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19) World Intellectual Property 
Organization 
International Bureau 

(43) International Publication Date 
30 June 2005 (30.06.2005) 




(10) International Publication Number 

PCT WO 2005/059835 Al 



(51) International Patent Classification 7 : 
(21) International Application Number: 



G06T 7/00 



PCT/IB20O4/052683 
(22) International Filing Date: 7 December 2004 (07.12.2004) 

(25) Filing Language: English 

(26) Publication Language: English 
(30) Priority Data: 



03104693.1 



15 December 2003 (15.12.2003) EP 



(71) Applicant (for all designated States except US): KONIN- 
KLUKE PHILIPS ELECTRONICS N.V. [NL/NL]; 
Groenewoudseweg 1, NL-5621 BA Eindhoven (NL). 



(72) Inventors; and 

(75) Inventors/Applicants (for US only): RODRIGUES, Rui, 
R, A. [PT/PT]; c/o Prof. Holstlaan 6, NL-5656 AA Eind- 
hoven (NL). ERNST, Fabian, E. [DE/NL1; c/o Prof. Holst- 
laan 6, NL-5656 AA Eindhoven (NL). VAN OVERVELD, 
Cornelius, W., A., M. [NL/NL]; c/o Prof. Holstlaan 6, 
NL-5656 AA Eindhoven (NL). BORBA RAMI RES FER- 
N ANDES, Antonio, J. [PT/PT]; c/o Prof. Holstlaan 6, 
NL-5656 AA Eindhoven (NL). 

(74) Agents: GROENENDAAL, Antonius, W.,M.etal.;Prof. 
Holstlaan 6, NL-5656 AA Eindhoven (NL). 

(81) Designated States (unless otherwise indicated, for every 
kind of national protection available): AE, AG, AL, AM, 
AT, AU, AZ, BA, BB, BG, BR, B W, BY, BZ, CA, CH, CN, 
CO, CR, CU, CZ, DE, DK, DM, DZ, EC, EE, EG, ES, FI, 
GB, GD, GE, GH, GM, HR, HU, ID, IL, IN, IS, JP, KE, 
KG, KP, KR, KZ, LC, LK, LR, LS, LT, LU, LV, MA, MD, 

/ Continued on next page] 



(54) Title: CONTOUR RECOVERY OF OCCLUDED OBJECTS IN IMAGES 



m 
oo 

IT) 

in 



O 



OBTAIN INTERRELATED VIDEO IMAGES Ii - I3 IN A FRAME 






f 




28^ 


SEGMENT THE IMAGES IN THE FRAME 





EXTRACT CONTOURS OF OBJECTS 



32 



34" 



36 



38 



40 



SELECT JUNCTION POINTS Ji - J 12 IN EACH IMAGE 



ASSOCIATE JUNCTION POINTS J WITH 
CORRESPONDING RECONSTRUCTED POINTS R BY 
MEANS OF THREE-DIMENSIONAL RECONSTRUCTION 



PROJECT RECONSTRUCTED POINTS INTO EACH IMAGE 

1 



LINK PROJECTED RECONSTRUCTED POINTS NOT 
PROJECTED AT A JUNCTION POINT TO EACH OTHER 
FOR OBTAINING A SET OF LINKS 



COMBINE THE LINKS FOR OBTAINING COMPLETE 
CONTOURS OF OBJECTS 



42" 



CODE IMAGES USING COMPLETE CONTOURS 
OF OBJECTS 



(57) Abstract: The present 
invention relates to a method, 
apparatus and computer 
program product for providing 
contour information related 
to images. An image obtaining 
unit obtains a set of interrelated 
images (step 26), an image 
segmenting unit segments 
said images, (step 28) and a 
contour determining unit (22) 
extracts at least two contours 
from the segmentation (step 
30), selects interest points on 
the contours of each image 
(step 32), associates interest 
points with corresponding 
reconstructed points by 
means of three-dimensional 
reconstruction (step 34), 
projects reconstructed points 
into the images (step 36), and 
links reconstructed points not 
projected at a junction or their 
projections to each other in 
order to provide a first set of 
links (step 38), such that at 
least a reasonable part of a 
contour of an object can be 
determined based on the linked 
reconstructed points. 
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